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We study a tractable opinion dynamics model that generates long-run disagreements and persistent opinion 
fluctuations. Our model involves a inhomogeneous stochastic gossip process of continuous opinion dynamics in 
a society consisting of two types of agents: regular agents, who update their beliefs according to information 
, that they receive from their social neighbors; and stubborn agents, who never update their opinions and might 

represent leaders, political parties or media sources attempting to influence the beliefs in the rest of the society. 
When the society contains stubborn agents with different opinions, the belief dynamics never lead to a consensus 
(among the regular agents). Instead, beliefs in the society almost surely fail to converge, the belief profile keeps 
on oscillating in an ergodic fashion, and it converges in law to a non-degenerate random vector. 



The structure of the graph describing the social network and the location of stubborn agents within it shape the 
opinion dynamics. The expected belief vector is proved to evolve according to an ordinary differential equation 



coinciding with the Kolmogorov backward equation of a continuos time Markov chain on the graph with absorbing 



states corresponding to the stubborn agents, and hence to converge to a harmonic vector, with every regular agent's 
value being the weighted average of its neighbors' values, and boundary conditions corresponding to the stubborn 
agents' beliefs. Expected cross-products of the stationary beliefs allow for a similar characterization in terms of 



. coupled random walks on the graph describing the social network. 



We prove that, in large-scale societies which are highly fluid, meaning that the product of the mixing time of the 
random walk on the graph describing the social network and the relative size of the linkages to stubborn agents 
vanishes as the population size grows large, a condition of homogeneous influence emerges, whereby the stationary 
beliefs' marginal distributions of most of the regular agents have approximately equal first and second moment. 
Homogeneous influence in a highly fluid societies need not imply approximate consensus among the agents, whose 
■ beliefs may well oscillate in an essentially uncorrelated way. 
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1. Introduction Disagreement among individuals in a society, even on central questions that have 
been debated for centuries, is the norm; agreement is the rare exception. How can disagreement of this 
sort persist for so long? Notably, such disagreement is not a consequence of lack of communication or 
some other factors leading to hxed opinions. Disagreement remains even as individuals communicate and 
sometimes change their opinions. 

Existing models of communication and learning, based on Bayesian or non-Bayesian updating mecha- 
nisms, typically lead to consensus provided that communication takes place over a strongly connected net- 
work (e.g., Smith and Sorensen [43], Banerjee and Fudenberg [7j, Acemoglu, Dahleh, Lobel and Ozdaglar 
PP, Bala and Goyal [BJ, Gale and Kariv [23], DeMarzo, Vayanos and Zwiebel [17], Golub and Jackson [24] . 
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Acemoglu, Ozdaglar and ParandchGhcibi [5]), and are thus unable to explain persistent disagreements. 
One notable exception is provided by models that incorporate a form of homophily mechanism in commu- 
nication, whereby individuals are more likely to exchange opinions or communicate with others that have 
similar beliefs, and fail to interact with agents whose beliefs differ from theirs by more than some given 
confidence threshold. This mechanism was first proposed by Axelrod [5] in the discrete opinion dynamics 
setting, and then by Krause |27j . and Dcffuant and Weisbuch [16 , in the continuous opinion dynamics 
framework. Such beliefs dynamics typically lead to the emergence of different asymptotic opinion clusters 
(see, e.g., [3TJ |H1 [H]); however, they are unable to explain persistent opinion fluctuations in the society. 

In this paper, we investigate a tractable opinion dynamics model that generates both long-run disagree- 
ment and opinion fluctuations. We consider an inhomogeneous stochastic gossip model of communication 
wherein there is a fraction of stubborn, agents in the society who never change their opinions. We show 
that the presence of stubborn agents with competing opinions leads to persistent opinion fluctuations 
and disagreement among the rest of the society. 

More specifically, we consider a society envisaged as a social network of n interacting agents (or 
individuals) , communicating and exchanging information. Each agent a starts with an opinion (or belief) 
X a (0) £ K and is then activated according to a Poisson process in continuous time. Following this event, 
she meets one of the individuals in her social neighborhood according to a prc-specificd stochastic process. 
This process represents an underlying social network. We distinguish between two types of individuals, 
stubborn and regular. Stubborn agents, which are typically few in number, never change their opinions: 
they might thus correspond to media sources, opinion leaders, or political parties wishing to influence the 
rest of the society, and, in a first approximation, not getting any feedback from it. In contrast, regular 
agents, which make up the great majority of the agents in the social network, update their beliefs to some 
weighted average of their pre-meeting belief and the belief of the agent they met. The opinions generated 
through this information exchange process form a Markov process whose long-run behavior is the focus 
of our analysis. 

First, we show that, under general conditions, these opinion dynamics never lead to a consensus (among 
the regular agents). In fact, regular agents' beliefs almost surely fail to converge, and keep on oscillating 
in an ergodic fashion. Instead, the belief of each regular agent converges in law to a non-degenerate 
stationary random variable, and, similarly, the vector of beliefs of all agents jointly converge to a non- 
degenerate stationary random vector. This model therefore provides a new approach to understanding 
persistent disagreements and opinion fluctuations. 

Second, we investigate how the structure of the graph describing the social network and the location 
of stubborn agents within it shape the behavior of the opinion dynamics. The expected belief vector is 
proved to evolve according to an ordinary differential equation coinciding with the Kolmogorov backward 
equation of a continuos time Markov chain on the graph with absorbing states corresponding to the 
stubborn agents, and hence to converge to a harmonic vector, with every regular agent's value being the 
weighted average of its neighbors' values, and boundary conditions corresponding to the stubborn agents' 
beliefs. Expected cross-products of the stationary beliefs allow for a similar characterization in terms of 
coupled random walks on the graph describing the social network. The characterization of the expected 
stationary beliefs as harmonic functions is then used in order to find explicit solutions for some social 
networks with particular structure or symmetries. 

Third, in what we consider the most novel contribution of our analysis, we study the behavior of 
the stationary beliefs in large-scale highly fluid social networks, defined as networks where the product 
between the fraction of edges incoming in the stubborn agent set times the mixing time of the associated 
random walk is small. We show that in highly fluid social networks, the expected value and variance of 
the stationary beliefs of most of the agents concentrate around certain values as the population size grows 
large. We refer to this result as homogeneous influence of stubborn agents on the rest of the society — 
meaning that their influence on most of the agents in the society are approximately the same. The 
applicability of this result is then proved by providing several examples of large-scale random networks, 
including the Erdds-gossip graph in the connected regime, power law networks, and small-world networks. 
Finally, we argue that homogeneous influence in a highly fluid societies need not imply approximate 
consensus among the agents, whose beliefs may well oscillate in an essentially uncorrelated way, leaving 
a deeper understanding of this topic as a matter for a future work. 
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Our main contribution partly stems from novel applications of several techniques of applied probability 
in the study of opinion dynamics. In particular, convergence in law and ergodicity of the agents' beliefs is 
established by first rewriting the dynamics in the form of an iterated affinc function system and then using 
techniques developed in this field (TB] . On the other hand, our estimates of the behavior of the expected 
values and variances of the stationary beliefs in large-scale highly fluid networks are based on techniques 
from the theory of reversible Markov chains, including approximate exponentiality of the hitting times 
and fast mixing [3] I28j , as well as on results in modern random graph theory |19j . 

In addition to the aforementioned works on learning and opinion dynamics, this paper is related to 
some of the literature in the statistical physics of social dynamics: see [TU] and references therein for an 
overview of such research line. More specifically, our model is closely related to some work by Mobilia 
and co-authors [33] |34j [35] , who study a variation of the discrete opinion dynamics model, also called 
the voter model, with inhomogeneities, there referred to as zealots: such zealots are agents which tend 
to favor one opinion in |33[ I34| , or are in fact equivalent to our stubborn agents in |35| . These works 
generally present analytical results for some regular graphical structures (such as regular lattices [33J 131] , 
or complete graphs [35] ). and arc then complemented by numerical simulations. In contrast, we prove 
convergence in distribution and characterize the properties of the limiting distribution for general finite 
graphs. Even though our model involves continuous belief dynamics, we will also show that the voter 
model with zealots of |35j can be recovered as a special case of our general framework. 

Our work is also related to work on consensus and gossip algorithms, which is motivated by different 
problems, but typically leads to a similar mathematical formulation (Tsitsiklis [25], Tsitsiklis, Bcrtsckas 
and Athans [46], Jadbabaie, Lin and Morse [26], Olfati-Saber and Murray [39], Olshevsky and Tsitsiklis 
[4"0] . Fagnani and Zampieri [32], Nedic and Ozdaglar [35]). In consensus problems, the focus is on 
whether the beliefs or the values held by different units (which might correspond to individuals, sensors, 
or distributed processors) converge to a common value. Our analysis here does not focus on limiting 
consensus of values, but in contrast, characterizes the stationary fluctuations in values. 

The rest of this paper is organized as follows: In Section [2] we introduce our model of interaction 
between the agents, describing the resulting evolution of individual beliefs, and we discuss two special 
cases, in which the arguments simplify particularly, and some fundamental features of the general case 
are highlighted. Section [3J presents convergence results on the evolution of agent beliefs over time, for a 
given social network: the beliefs are shown to converge in distribution, and to be an stationary process, 
while in general they do not converge almost surely. Section [¥] presents a characterization of the first 
and second moments of the stationary beliefs in terms of the hitting probabilities of two coupled random 
walks on the graph describing the social network. Section [SJ narrows down the discussion to reversible 
social networks, and presents explicit computations of the expected stationary beliefs and variances for 
some special network topologies. Section [5] provides bounds on the level of dispersion of the first two 
moments of the stationary beliefs: it is shown that, in highly fluid networks, most of the agents have 
almost the same stationary belief and variance. Section [7] presents some concluding remarks. 

Basic Notation and Terminology We will typically label the entries of vectors by elements of finite 
alphabets, rather than non-negative integers, hence R 1 will stand for the set of vectors with entries 
labeled by elements of the finite alphabet I. An index denoted by a lower-case letter will implicitly be 
assumed to run over the finite alphabet denoted by the corresponding calligraphic upper-case letter (e.g. 
J2i will stand for JZipi)- F° r an y finite set J , we use the notation lj to denote the indicator function 
over the set J, i.e., is equal to 1 if j € J, and equal to otherwise. For a matrix M £ M. Ix ^, 

M T <E M. jxl will stand for its transpose, ||A/|| for its 2-norm. For a probability distribution [i over a 
finite set I, and a subset J C X we will write /i(i7) := ■ Mi- If v i s another probability distribution on 

X, we will use the notation — v\\tv '■= \ Yli ~ v i\ = SU P {l/ i (^) — v {^)\ '■ ^7 C 1} , for the total 
variation distance between \x and v. The probability law (or distribution) of a random variable Z will 
be denoted by C(Z). We will often refer to continuous-time Markov chains on a finite set V as random 
walks on V. Such random walks will be characterized by their generator matrix M € R VxV , which has 
zero row sums, and whose non-diagonal elements are nonnegative and correspond to the rates at which 
the chain jumps from a state to another (see [38] Ch.s 2-3]). If V(t) and V'(t) are random walks on V, 
defined on the same probability space, we will use the notation P„( • ), and ¥ vv >( • ), for the conditional 
probability measures given the events V(0) = v, and, respectively, (V(0),V'(0)) = (v,v'). Similarly, for 
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Figure 1: A social network with seven regular agents (colored in grey), and five stubborn agents (colored 
in white, and black, respectively). Links are only incoming to the stubborn agents, while links between 
pairs of regular agents may be uni- or bi-directional. 

some probability distribution tt over V (possibly the stationary one), P ff ( • ) := J2 V v> 

( • ) will 

denote the conditional probability measure of the random walk with initial distribution n, while E„[-], 
E„ ,/[•], and E^-] will denote the corresponding conditional expectations. For two non-negative real- 
valued sequences {a n : n € N}, {b n : n £ N}, we will write a n = 0(b n ) if for some positive constant K, 
a n < Kb n for all sufficiently large n, a n = Q(b n ) if b n = 0(a n ), ) if lim n a n /b n = 0. 



2. Belief evolution model We consider a finite population V of interacting agents, of possibly 
very large size n := |V|. The connectivity among the agents is described by a simple directed graph 
y = ( V, £ ) , whose node set is identified with the agent population, and where £ C V x V \ V, with 
V := {(v,v) : v £ V}, stands for the set of directed edges (or links) among the agents0 

At time t > 0, each agent v £ V holds a belief (or opinion) about an underlying state of the world, 
denoted by X v (t) £ R. The full vector of beliefs at time t will be denoted by X(t) = {X v (t) : v £ V}. 
We distinguish between two types of agents: regular and stubborn. Regular agents repeatedly update 
their own beliefs, based on the observation of the beliefs of their out-neighbors in y . Stubborn agents 
never change their opinions, i.e., they do not have any out-neighbors. Agents which are not stubborn are 
called regular. We will denote the set of regular agents by A, the set of stubborn agents by S, so that 
the set of all agents is V = A U S (see Figured]). 

More specifically, the agents' beliefs evolve according to the following stochastic update process. At 
time t = 0, each agent v € V starts with an initial belief X v (0). The beliefs of the stubborn agents stay 
constant in time: 

X s {t) = X s (0) =: x s , seS. 

In contrast, the beliefs of the regular agents are updated as follows. To every directed edge in ~i of 
the form (a,v), where necessarily a £ A, and v £ V, a clock is associated, ticking at the times of an 
independent Poisson process of rate r av > 0. If the (a,w)-th clock ticks at time t, agent a meets agent v 
and updates her belief to a convex combination of her own current belief and the current belief of agent 



v: 



X a (t) 



1 



■j)X a (t ) + 9 av X v (t ) 



(1) 



where X v (t ) stands for the left limit lim M -|- t X v (u). Here, the scalar 9 av £ (0, 1] is a trust parameter that 
represents the confidence that the regular agent a £ A puts on agent v 's belief! That r av and 6 av are 
strictly positive for all (a, v) £ £ is simply a convention (since if r av 9 av = 0, one can always consider the 
subgraph of obtained by removing the edge (a,v) from £)■ Similarly, we also adopt the convention 



1 Notice that we don't allows for parallel edges or self-loops. 

2 We have imposed that at each meeting instance, only one agent updates her belief. The model can be easily extended 
to the case where both agents update their beliefs simultaneously, without significantly affecting any of our general results. 
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that r vv i = 6 vv i = for all v, v' £ V such that (v, v') £ £ (hence, including self-loops v' — v). For 
every regular agent a £ A, let S a C S be the subset of stubborn agents which are reachable from a by 
a directed path in y . We refer to S a as the set of stubborn agents influencing a. For every stubborn 
agent s £ S, A s ■= {a : s £ S a } C „4 will stand for the set of regular agents influenced by s. 

The tuple TV = f ~$ , {9 e }, {r e }j contains the entire information about patterns of interaction among 
the agents, and will be referred to as the social network. Together with an assignment of a probability 
law for the initial belief vector, C(X(0)), the social network designates a society. Throughout the paper, 
we make the following assumptions regarding the underlying social network. 

Assumption 2.1 Every regular agent is influenced by some stubborn agent, i.e., S a is non-empty for 
every a in A. 



Assumption 12.11 may be easily removed. If there are some regular agents which are not influenced by 
any stubborn agent, then there is no edge in £ connecting the set 1Z of such regular agents to V \1Z. 
Then, one may decompose the subgraph obtained by restricting Q to 1Z into its communicating classes, 
and apply the results in |22j (see Example 3.5 therein), showing that, with probability one, a consensus 
on a random belief is achieved on every such communicating class. 

We denote the total meeting rate of agent v £ V by r v , i.e., r v := XX>'ev r w, and the total meeting 
rate of all agents by r, i.e., r := X^ev r *>- We use N(t) to denote the total number of agent meetings (or 
edge activations) up to time t > 0, which is simply a Poisson arrival process of rate r. We also use the 
notation to denote the time of the k-th belief update, i.e., Tfc := infjt > : N(t) > k}. 

For a given social network, we associate two matrices Q £ R VxV , with entries 

Qvw '— Qvwr-vw Qvv ■ — / Q vv' , ^ -f- W G V , (2) 

* — *v'^v 

and P G ]R- /l><v , whose entries arc defined by 

Pav = -Qav/Qvv , a G A , V G V . (3) 



The following example describes the canonical construction of a social network from an undirected 
graph, and will be used often in the rest of the paper. 

Example 2.1 Let Q — (V,£) be an undirected connected graph, and S C V, A = V \ S. Define the 
directed graph ~3 = (V,t), where (a,v) G t if and only if a G A, v G V, and {a,v} G £, i.e., t 
is the directed graph obtained by making all edges in £ bidirectional except edges between a regular and 
a stubborn agent, which are unidirectional (pointing from the regular agent to the stubborn agent). For 
every node v G V, let d v be its degree in Q . Let the trust parameter be constant, i.e., 9 av = 9 G (0, 1] for 
all (a,v) G £ . Define 

r av = l/d a , a € A, v € V : {a,v} £ £ . (4) 

This concludes the construction of the social network Af = (~S i {^e} 5 { r e}^ • For this social network, one 
has 

Qav=9/d a , P av = l/d a , V(a,«)G£. 



We conclude this section by discussing in some detail two special cases whose simple structure sheds 
light on the main features of the general model. In particular, we consider a social network with a single 
regular agent and a social network where the trust parameter satisfies 9 av = 1 for all a £ A and v £ V. 
We show that in both of these cases agent beliefs almost surely fail to converge. 

2.1 Single regular agent Consider a society consisting of a single regular agent, i.e., A = {a}, and 
two stubborn agents, S = {s, s'} (sec Fig.[2ja)). Assume that r as = r as i = 1/2, 9 as = 9 as / = 1/2, x s = 0, 
x s i = 1, and X a (0) = 0. Then, one has for all t > 0, 

X a (t)= 2 fc - JV W- 1 ^(fc), 

l<fc<JV(t) 



G 
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(a) (b) (c) 

Figure 2: Typical sample-path behavior of the belief of the regular agent in the simple social network 
topology depicted in (a). In (b) the actual belief process X a (t), oscillating ergodically on the interval 
[0, 1]; in (c), the time-reversed process, rapidly converging to a stationary random belief X a . 



where N(t) is the total number of agent meetings up to time t (or number of arrivals up to time t 
of a rate-1 Poisson process), and {W(k) : k € N} is a sequence of Bernoulli (1/2) random variables, 
independent mutually and from the process N(t). Observe that, almost surely, arbitrarily long strings 
of contiguous zeros and ones appear in the i.i.d. sequence {W(fc)}, while the number of meetings N(t) 
grows unbounded. It follows that, with probability one 

liminf X a (t) = 0, \imsup X a (t) = 1 , 

so that the belief X a (t) does not converge almost surely. 

On the other hand, observe that, since X)/c>ri 2 _fc |VF(fc) < 2~ n , the series X a 
sample-wise converging. It follows that, as t grows large, the time-reversed process 

l<k<N(t) 

converges to X ai with probability one, and, a fortiori, in distribution. Notice that, for all positive integer 
k, the binary fc-tuples {W(l), . . . , W(k)} and {W{k), . . . , W(l)} are uniformly distributed over {0, l} fc , 
and independent from the Poisson arrival process N(t). It follows that, for all t > 0, the random variable 
X~ a (t) has the same distribution as X a (t). Therefore, X a {t) converges in distribution to X a as t grows 
large. Moreover, it is a standard fact (see e.g. [42[ pag.92]) that X a is uniformly distributed over the 
interval [0, 1]. Hence, the probability distribution of X a (t) is asymptotically uniform on [0, 1]. 

The analysis can in fact be extended to any trust parameter 6i s = 9i s > = 9 G (0, 1). In this case, one 
gets that 

X a (t) = 6) N{t) ~ k W(k) 

l<k<N(t) 

converges almost surely to the stationary belief 

X a := 0(1 - 6)- 1 ^(1 -0) k W(k). (5) 
fe>i 

As explained in [TH1 Section 2.6], for every value of 9 in (1/2, 1), the probability law of X a is singular, and 
in fact supported on a Cantor set. In contrast, for almost all values of 9 € (0, 1/2), the probability law 
of X a is absolutely continuous with respect to Lebesgue's measure^ In the extreme case 9 = 1, it is not 
hard to see that X a (t) = W(N(t)) converges in distribution to a random variable X a with Bcrnoulli(l/2) 
distribution. On the other hand, observe that, regardless of the fine structure of the probability law of the 
stationary belief X a , i.e., on whether it is absolutely continuous or singular, it is not hard to characterize 



:= E fc >i2- fc ^(fc) is 



3 See 1411 . In fact, explicit counterexamples of values of 6 S (0,1/2) for which the asymptotic measure is singular are 
known. For example, Erdos 1201 1211 showed that, if 9 = (3 — v5)/2, then the probability law of X a is singular. 
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Figure 3: Duality between the voter model with zealots and the coalescing random walks process with 
absorbing states. The network topology is a line with five regular agents and two stubborn agents placed 
in the two extremities. The time index for the opinion dynamics, t, runs from left to right, whereas the 
time index for the coalescing random walks process, u, runs from right to left. Both dotted and solid 
arrows represent meeting instances. Fixing a time horizon t > 0, in order to trace the beliefs X(t), 
one has to follow coalescing random walks starting at u — in the different nodes of the network, and 
jumping from a state to another one in correspondence to the solid arrows. The particles are represented 
by bullets at times of their jumps. Clusters of coalesced particles are represented by bullets of increasing 
size. 

its moments for all values of 9 G (0, 1]. In fact, it follows from (JSJ) , that 

by 

E[X a ] = 9(1 - 6*)- 1 ^(1 - 9) k E[W(k)} = 9 ^(1 

k>l k>0 

and, using the mutual independence of the VF(fc)'s, the variance of X a 

Vax[Xj = tf 2 (l - ey 2 £(1 - 9f k Vax[W(k)} = 9 2 £(1 - 9f k ^ = — °— . 

fc>l k>0 * ' 

2.2 Voter model with zealots We now consider the special case when the social network topology 
—>G is arbitrary, and 9 av = 1 for all (a,v) G £. In this case, whenever an edge (a,v) G £ is activated, 
the regular agent a adopts agent u's current opinion as such, completely disregarding her own current 
opinion. 

This opinion dynamics, known as the voter model, was introduced independently by Clifford and 
Sudbury [IT] , and Holley and Liggett [25] . It has been extensively studied in the framework of interacting 
particle systems [201 [30] . While most of the research focus has been on the case when the graph is an 
infinite lattice, the voter model on finite graphs, and without stubborn agents, was considered, e.g., in 
[131 [H], [3] Ch. 14], and [JjJl Ch. 6.9]: in this case, consensus is achieved in some finite random time, 
whose distribution depends on the graph topology only. 

In some recent work [35] a variant with one or more stubborn agents (there referred to as zealots) has 
been proposed and analyzed on the complete graph. We wish to emphasize that such voter model with 
zealots can be recovered as a special case of our model, and hence our general results, to be proven in 
the next sections, apply to it as well. However, we briefly discuss this special case here, since proofs are 
much more intuitive, and allow one to anticipate some of the general results. 

The main tool in the analysis of the voter model is the dual process, which runs backward in time 
and allows one to identify the source of the opinion of each agent at any time instant. Specifically, let 
us focus on the belief of a regular agent a at time t > 0. Then, in order to trace X a (t), one has to look 
at the last meeting instance of agent a that occurred no later than time t. If such a meeting instance 
occurred at some time t — XJ\ G [0, t) and the agent met was v G V, then the belief of agent a at time t 
coincides with the one of agent v at time t — Ui, i.e., X a (t) = X v (t — U\). The next step is to look at the 
last meeting instance of agent v occurred no later than time t — U\ ; if such an instance occurred at time 



the expected value of X a is given 

-9f l -= 1 -, 
'2 2 

is given by 
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Figure 4: Typical sample-path behavior of the beliefs, and their crgodic averages for a social network with 
population size n — 4. The topology is a line graph, displayed in (a). The stubborn agents corresponds 
to the two extremes of the line, S — {0,3}, while their constant opinions are xq = 0, and 23 = 1. The 
regular agent set is A = {1,2}. The confidence parameters, and the interaction rates are chosen to be 
Qav = 1/2, and r av = 1/3, for all a = 1,2, and v = a ± 1. In picture (b), the trajectories of the actual 
beliefs X v (t), for v = 0, 1, 2, 3, are reported, whereas picture (c) reports the trajectories of their ergodic 
averages {Z v (t) := t^ 1 f Q X v (u)du}. 



t — U2 £ [0,t — Ui], and the agent met was w, then X a (t) = X v (t — Ui) = X w (t — 1/2). Clearly, one can 
iterate this argument, going backward in time, until reaching time 0. In this way, one implicitly defines 
a random walk V a (u) with state space V, which starts at V a (0) = a and stays put there until time U\, 
when it jumps to node v and stays put there in the time interval [t/i, U2), then jumps at time U2 to node 
w, and so on. It is not hard to see that, thanks to the fact that the meeting instances are independent 
Poisson processes, the random walk V a (u) has generator matrix Q. In particular, it halts when it hits 
some state s 6 S. This shows that C{X a {t)) = C(X Va (t){0)) ■ More generally, if one is interested in the 
joint probability distribution of the belief vector X(t), then one needs to consider n — \S\ random walks, 
{V a (t) : a £ A} each one starting from a different node a £ A, and run simultaneously on V (see Figure 
|3|). These random walks move independently with generator matrix Q, until the first time that they 
either meet, or they hit the set S: in the former case, they stick together and continue moving on V as 
a single particle, with generator matrix Q; in the second case, they halt. This process is known as the 
coalescing random walk process with absorbing set S. Then, one gets that 

£({X a (t) : aeA}) = £({X Va{t) (0) : a E A}) . (6) 

Equation ([5]) establishes a duality between the voter model with zealots and the coalescing random walks 
process with absorbing states. In particular, Assumption 12.11 implies that, with probability one, each 
V a (u) will hit the set S in some finite random time T§, so that in particular the vector {V a (u) : a 6 .4} 
converges in distribution to an S A - valued random vector {V a (T§) : a € A}. It then follows from ([5]) that 
X(t) converges in distribution to a stationary belief vector X whose entries are given by X s = x s for 
every stubborn agent s £ <S, and X a = Xv a (r a ) f° r every regular agent a G A. 

3. Convergence in distribution and ergodicity of the beliefs This section is devoted to study- 
ing the convergence properties of the random belief vector X(t) for the general update model described 
in Section [21 Figure 2] reports the typical sample-path behavior of the agents' beliefs for a simple so- 
cial network with population size n = 4, and line graph topology, in which the two stubborn agents 
are positioned in the extremes and hold beliefs xo < £3. As shown in Fig. SJb), the beliefs of the two 
regular agents, Xi(t), and ^(t), oscillate persistently in the interval [xo,X3] . On the other hand, the 
time averages of the two regular agents' beliefs rapidly approach a limit value, of 2xo/3 + £3/3 for agent 
1, and xo/3 + 2x3/3 for agent 2. 

As we will see below, such behavior is rather general. In our model of social network with at least 
two stubborn agents having non-coincident constant beliefs, the regular agent beliefs almost surely fail 
to converge: we have seen this in the special cases of Section I2TT1 while a general result in this sense will 
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be stated as Theorem 13. 21 On the other hand, we will prove that, regardless of the initial regular agents' 
beliefs, the belief vector X(t) is convergent in distribution to a random stationary belief vector X (see 
Theorem 13. ip . and in fact it is an ergodic process (see Corollary 13. ip . 

In order to prove Theorem 13.11 we will rewrite X{t) in the form of an iterated affine function system 
and apply standard techniques in this field |18j . In particular, we will consider the so-called time- reversed 
belief process. This is a stochastic process whose marginal probability distribution, at any time t > 0, 
coincides with the one of the actual belief process, X(t). In contrast to X(t), the time-reversed belief 
process is in general not Markov, whereas it can be shown to converge to a random stationary belief 
vector with probability one. From this, we recover convergence in distribution of the actual belief vector 
X(t). 

Formally, for any time instant t > 0, let us introduce the projected belief vector Y(t) £ M" 4 , where 
Y a {t) = X a (t) for all a £ A. Let I A e R AxA he the identity matrix, and for a £ A, let e( n ) £ R A be the 
vector whose entries are all zero, but for the a-th which equals 1. For every positive integer fc, consider 
the random matrix A(k) £ M. AxA , and the random vector B(k) £ M. A , defined by 

A(k) = I A + 8 aa , (e {a) ej al) - e (o) ef a) ) B(k) = , 

if the fc-th activated edge is (a, a') £ £, with a, a' £ A, and 

A(k) =Ia~ Qa S e(a)eJa) B ( k ) = e {a) 6 as x s , 
if the fc-th activated edge is (a, s) £ £ , with a £ A, and s £ S. Define the matrix product 

~2{k,l) := A(l)A(l- l)...A(k + l)A(k), l<k<l, (7) 
with the convention that A (fc, I) = I a for fc > I. Then, one has 

Y(T n ) = A(n)Y(T~) + B(n) = A(n)Y(T n _i) + B{n) , n > 1 , 
so that, for alii > 0, 

Y(t)=A*(l,N(t))Y(Q)+ J2 ~^(k + l,N{t))B(k), (8) 

l<fc<JV(t) 

where we recall that N(t) is the total number of agents' meetings up to time t. Now, define the time- 
reversed belief process 

^{t):=A~{l,N{t))Y{<S)+ ^(M-IWO, (9) 

l<fe<iV(t) 

where 

A(k, I) := A(k)A(k + 1) . . . A(l - l)A(l) , k < I , 
with the convention that A{k,l) = I a for fc > I. The following is a fundamental observation see [T5] : 

Lemma 3.1 For all t>0, Y(t) and Y(t) have the same probability distribution. 

Proof. Notice that {(A(k), B(k)) : fc £ N} is a sequence of independent and identically distributed 
random variables, independent from the process N(t). This, in particular, implies that, the Z-tuplc 
{(A(k), B{k)) : 1 < fc < 1} has the same distribution as the /-tuple {(A(l-k+l), B(l-k+l)) : 1 < k < I}, 
for all I £ N. From this, and the identities ([8} and ((9j), it follows that the belief vector Y(t) has the same 
distribution as Y (t), for all t > 0. ■ 

The second fundamental result is that, in contrast to the actual regular agents' belief vector Y(t), 
the time-reversed belief process Y(t) converges almost surely. This is formalized in the next lemma, 
whose proof relies on showing that the matrices A(k) are contractive in the average, as a consequence of 
Assumption 12.11 

Lemma 3.2 Let Assumvtion \2.l\ hold. Then, for every value of the stubborn agents' beliefs {x s } £ Mr, 
there exists an M A -valued random variable Y , such that, 

P ( lim V{t) = y) = 1 , 

for every initial distribution C(Y(0)) of the regular agents' beliefs. 
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Proof. Observe that the expected entries of A(k), and B(k), are given by 

E[A»'(fc)] = — , E[A aa (k)):=l--y i Q av , E[B a (k)] = -y2Q as 



r * — ' r 

uGV s£S 



for all a ^ a' G A. In particular, EL4(fc)] is a substochastic matrix. Moreover, it follows from Assumption 
2.1 that there exists j such that S a ^[Aj'J(^) < 1- This implies that the spectral radius p of EL4(fc)] is 
strictly less than one. Standard linear algebra then shows that 



<Ck n ~ 1 p k , Vfc>0, 



E 

where C is a constant depending on E[A(1)] only. It follows that 



inf -fl 

feGN k 



,,,, 1 . ~ 1 



feGN k 



log(Crefc n -V) 



log||A(l,fc)||i <inf-logE ||A(l,/c)||i < lim — ^ ^=logp<0. (10) 



fe— >oc 



Hence, it follows from [TH1 Th. 2.1] that, with probability one, the series 

<-r, 



r:=VjA(l,i-l)B(i) 



fe>i 

is convergent, and A~(l,k)Y(0) converges to as k grows large. Since, with probability one, N(t) goes 
to infinity as t grows large, one has that 

lim V(t) = lim A~ (l,N(t))Y(0) + V 5[(1, j - l)B(j) = Y , 

l<j<N(t) 

with probability one. This completes the proof. ■ 

Lemma |3. II and Lemma 13.21 allow one to prove convergence in distribution of X(t) to a random belief 
vector X, as stated in the following result. 

Theorem 3.1 Let Assumption \2.l\ hold. Then, for every value of the stubborn agents' beliefs {x s : 
s 6 5}, there exists an Wi v -valued random variable X, such that, for every initial distribution C(X(0)) 
satisfying ¥(X S (0) = x s ) = 1 for every s G S, 

lim E[<p(X(t))} = E[tp(X)] , 

t— >oo 

for all bounded and continuous test functions (p : R v — > R. Moreover, the probability law of the stationary 
belief vector X is invariant for the system, i.e., if £(X(0)) = C(X), then C{X{t)) = C(X) for all t > 0. 

PROOF. It follows from Lemma [3.21 Y(t) converges to Y with probability one, and a fortiori in dis- 
tribution. By Lemma [331 ^(t) and Y(t) are identically distributed. Therefore, Y(t) converges to Y in 
distribution, and the first part of the claim follows by defining X a = Y a for all a £ A, and X s = x s 
for all s G S. For the second part of the claim, it is sufficient to observe that the distribution of 
Y = J2k>i ^4 (1, fc — l)-B(fc) is the same as the one of Y' := A(Q)Y + B(0), where A(Q), and B(0), are 
independent copies of A(l), and B(l), respectively. ■ 

Motivated by Theorem 13. 1[ for any agent v G V, we refer to the random variable X v as the stationary 
belief of agent v. Using standard ergodic theorems for Markov chains, an immediate implication of 
Theorem l3.1l is the following corollary, which shows that time averages of any continuous bounded function 
of agent beliefs are given by their expectation over the limiting distribution. Choosing the relevant 
function properly, this enables us to express the empirical averages of and correlations across agent 
beliefs in terms of expectations over the limiting distribution, highlighting the crgodicity of agent beliefs. 

COROLLARY 3.1 Let Assumvtion \2. l\ hold. Then, for every value of the stubborn agents' beliefs {x s : s G 
S}, with probability one, 

1 t* 

lim - / (p(X(u))du = E[ip(X)] , 

t^oo t Jq 

where X is the stationary belief vector and cp : R v — > R is any continuous test function such that E[ip(X)] 
exists and is finite. 
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Proof. Let Y(t) and Y be the projections of the belief vector at time t > 0, and of the stationary 
belief vector A, respectively, to the regular agents set A. Let Y(0) be an R^-valued random vector, 
independent from Y(Q) and such that C(Y(0)) = C(Y). Let Y(t) be as in ([5]), and 

Y(t) = l(l,N(t))Y(0)+ Y, ~%(k + l,N(t))B(k), 

l<k<N(t) 

where N(t) is the total number of agents' meetings up to time t, and ,1) is defined as in ([7]). Then, 

Y(t)-Y(t) = ^(l,N(t))(Y(0)-Y(0)). 

Arguing as in the proof of Lemma [5721 one shows that lim t _ i . 00 — ^(i)|| = , with probability one. 

Now, for t > 0, let the vectors X(t) and X(t) be defined by X a (t) = Y a (t), X a (t) = Y a (t) for a e A, and 
X s (t) = X s (t) = x s for s G S, and observe that, with probability one, sup t>0 \X(t)\ < max„ |A„(0)| < oo, 
sup t>0 |-X"(t)| < max„ \X V \ < oo. Then, for every continuous (f : R v — > R, one has that 

lim \ ( p(X(t))-cp(X(t))\=0, 



t- 



with probability one. On the other hand, stationarity of the process X(t) allows one to apply the ergodic 
theorem (see, e.g., [HI Theorem 6.2.12]), showing that, if E[<^(A)] exists and is finite, then 

i r* ~ 

lim - / <p(X(s))ds = E[<p(X)] , 



with probability one. Then, for any continuous ip such that E[</?(X)] exists and is finite, one has that 
1 



<p(X(8))d8-E[<p(X)] 



(i 



t 

with probability one 







< 


-1 




t Jo 



^(X( S ))ds-EKX)] 



1 



V (X(s))- V (X(s)) 



, t-yoo „ 

as — > , 



Theorem 13.11 and Corollary 13.11 respectively, show that the beliefs of all the agents converge in 
distribution, and that their empirical distributions converge almost surely, to a random stationary belief 
vector X. In contrast, the following theorem shows that the stationary belief of a regular agent which is 
connected to at least two stubborn agents with different beliefs is a non-degenerate random variable. As 
a consequence, the belief of every such regular agent keeps on oscillating with probability one. Moreover, 
the theorem shows that, with probability one, the difference between any pair of distinct regular agents 
which arc influenced by more than one stubborn agent does not converge to zero, so that disagreement 
between them persists in time. For a G A, let X a — {x s : s G S a } denote the set of stubborn agents' 
belief values influencing agent a. 



Theorem 3.2 Let Assumption \2.l\ hold, and let a G A be such that \X a \ > 2. Then, the stationary 
belief X a is a non-degenerate random variable. Furthermore, if a, a' G A, with a' a are such that 
\X a n X a , | > 2, then ¥(X a +X a ,)> 0. 



Proof. With no loss of generality, since the distribution of the stationary belief vector X does not 
depend on the probability law of the initial beliefs of the regular agents, we can assume that such a law 
is the stationary one, i.e., that C(X(0)) = C(X). Then, Theorem 13.11 implies that 

C(X(t)) = C{X), Vt>0. (11) 

Let a G A be such that X a is degenerate. Then, almost surely, X a (t) = x a for almost all t, for some 
constant x a . Then, as we will show below, all the out- neighbors of a will have their beliefs constantly 
equal to x a with probability one. Iterating the argument until reaching the set iS a , one eventually finds 
that x s = x a for all s G S, so that \X a \ = 1. This proves the first part of the claim. For the second part, 
assume that X a = X a i almost surely for some a ^ a' . Then, one can prove that, with probability one, 
every out-neighbor of a or a' agrees with a or a' at any time. Iterating the argument until reaching the 
set S a U S a >, one eventually finds that \X S U X s / \ = 1. 

One can reason as follows in order to see that, if v is an out-neighbor of a, and X a = x a is degenerate, 
then X v (t) = x a for all t. Let T£ v be the n-th activation of the edge (a, v). Then, Equation ((T|) implies 
that 

X v (T™)=x a , Vn>l. (12) 
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(a) (b) (c) 



Figure 5: In (a), a network topology consisting of a line with three regular agents and two stubborn 

agents placed in the extremes. In (b), the corresponding graph product (/□• The latter has 25 nodes, 

four of which are absorbing states. The pair (V(t),V (t)) of the coupled random walks moves on Q\j, its 

two components jumping independently to neighbor states, unless they are either on the diagonal, or one 

of them is in S: in the former case, there is some chance that the two components jump as a unique one, 

thus inducing a direct connection along the diagonal; in the latter case, the only component that can 

keep moving is the one which has not hit S, while the one who hit S is bound to remain constant from 

— ► 

that point on. In (c), the product graph is reported for the extreme case when 9 e = 1 for all e ££ . 
In this case, the coupled random walks (V(t), V'{t)) are coalescing: once they meet, they stick together, 
moving as a single particle, and never separating from each other. This reflects the fact that there are 
no outgoing edges from the diagonal set. 



Now, define T* := inf{£ > : X v (t) ^ x a }, and assume by contradiction that P(T* < oo) > 0. By the 
strong Markov property, and the property that edge activations are independent Poisson processes, this 
would imply that 

P(first edge activated after T* is {a,v)\F T *) > on {T* < oo} , (13) 

which would contradict (|12p . Then, necessarily T* = oo, and hence X v = X a , with probability one. 

On the other hand, assume that X a = X a i with probability one, let v be an out-neighbor of a, and 
T£ v be the n-th activation of edge (a, v). Then, 

X V (T™) = X a (T™) , Vn>l. (14) 

Let T* := inf{t > : X v (t) ^ X a (t)}, and assume by contradiction that P(T* < oo) > 0. Then, arguing 
as above, one would find that (|13l) holds. Upon observing that almost surely two edges are never activated 
at the same time, this can be easily shown to contradict (|14p . so that necessarily T* = oo, and hence 
X v = X a = X a i, with probability one. M 

Even though, by Theorem 13.11 the belief of any agent always converges in distribution, Theorem 13.21 
shows that, if a regular agent a is influenced by stubborn agents with different beliefs, then her stationary 
belief X a is non-degenerate. By Corollary 13.11 this implies that, with probability one, her belief X a (t) 
keeps on oscillating and does not stabilize on a limit. Similarly, Theorem 13.21 and Corollary 13.11 imply 
that, if two regular agents are influenced by stubborn agents with different beliefs, then, with probability 
one, their beliefs will not achieve a consensus asymptotically. 

4. Empirical averages and correlations of agent beliefs In this section, we provide a char- 
acterization of the empirical averages of the agents' beliefs and their cross-products, i.e., of the almost 
surely constant limits 

If* If* , 

lim - / X v (u)du, lim - / X v (u)X v i (u)du , v, v G V . 

i^oo t J t^oo t J 

Since the stationary beliefs X v take values in the interval [min s x s , max s x s ], one has that both E[X t) ] 
and E[X„X„/] exist and are finite. Hence, Corollary 13.11 implies that the limits above are given by the 
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first two moments of the stationary beliefs, i.e., 
distribution of initial regular agents' beliefs. 



i[X v ] and E[X„X„/], respectively, independently of the 



We next provide explicit characterizations of these limits in terms of hitting probabilities of a pair of 
coupled random walks on y = (V, £ )0 Specifically, we consider a coupling (V(t), V'(t)) of continuous- 
time Markov chains with state space V, such that both V{t) and V'{t) have generator matrix Q, as 
defined in ©. In fact, one may interpret the continuous-time Markov chain (V(t),V'(t)) as a random 
walk on the Cartesian power graph (?□, whose node set is the product V x V, and where there is an edge 
from (v, v') to (w, w'), if and only if either (v, w) £~£ and v' = w' , or v = w and (v' , w') S ~^ , or v = v' 
and w = w' (See FigureJS]). Such coupled random walks pair (V(t), V'(t)) has generator matrix K whose 
entries are given by 



K 



(v ,v')(w ,w') 



Qvw 


if v 


/ 


v' 


v =/= w , 


u' = w' 


Qv'w' 


if v 


/ 


v' 


V = w , 


v' u/ 





if v 


/ 


v' 




v' / w' 


Qvv Qv'v' 


if v 


/ 


v' 


u = iu , 


v' = w' 




if v 




v' 


it; = «/ 


, v ^ w 


(1 @viv)Qvw 


if v 




v' 


v =/= w , 


v' = u/ 


(1 ^vw'jQvw' 


if v 




v' 


V = w , 


v' 7^ u/ 





if v 




v' 


w 7^ u/ 


, W ^ V 


1Q VV -\- 9vv"Qvv" 


if V 




v' 


w = iu , 


v 1 = w' 



(15) 



w' ± v' 



The first four lines of (|15l) state that, conditioned on (V(i), V'(t)) being on a pair of non-coincident nodes 
(v, v'), each of the two components, V(t) (respectively, V'(t)), jumps to a neighbor node w, with transition 
rate Q vw (respectively, to a neighbor node w' with transition rate Q v > w >), whereas the probability that 
both components jump at the same time is zero. On the other hand, the last five lines of (|15[) state that, 
once the two components have met, i.e., conditioned on V(t) = V'(t) = v, they have some chance to 
stick together and jump as a single particle to a neighbor node w, with rate 9 vw Q VWl while each of the 
components V(t) (respectively, V'(t)) has still some chance to jump alone to a neighbor node w with rate 
(1 — VW )Q VW (resp., to w 1 with rate (1 — 9 vw i)Q vw i). In the extreme case when 9 VW — 1 for all v,w, the 
sixth and seventh line of the righthand side of (fT5")) equal 0, and in fact one recovers the expression for 
the transition rates of two coalescing random walks: once V{t) and V'(t) have met, they stick together 
and move as a single particle, never separating from each other. 



For v, w, v' , w' £ V, and t > 0, we will denote by 
7 »(t) :=F v (V(t)=w)=F v (V'(t)=w), 



V v S(t)=Pw'(V(t)=w,V'(t) = w') 



(16) 



the marginal and joint transition probabilities of the two random walks at time t. It is a standard fact (see, 
e.g., |38l Theorem 2.8.3]) that such transition probabilities satisfy the Kolmogorov backward equations 

^7Z(t)=J2Qvvii(t), ^it^Evx^iiitt')- v,v',w, w 'ev, (17) 



dt 

V 

with initial condition 

7^(0) = 



1 if v = w 
if 



1 if (v, v') = (w, w') 
if {v,v')^{w,w') 



(18) 



The next simple result provides a fundamental link between the belief evolution process introduced 
in Section [2] and the coupled random walks, by showing that the expected values and expected cross- 
products of the agents' beliefs satisfy the same linear system (fT7|) of ordinary differential equations as 
the transition probabilities of (V(t),V'(t)). 

Lemma 4.1 For all v, v' 6 V, and t > 0, it holds 

^E[X v (t)} = ]T Q vw E[X w (t)} , ^E[X v (t)X v ,(t)} = Y, K {v , v , ){wwl) E[X w (t)X w ,(t)} . (19) 



4 Notc that the set of states for such a random walk corresponds to the set of agents, therefore we use the terms "state" 
and "agent" interchangeably in the sequel. 
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Proof. Recall that, for the belief update model introduced in Section^ arbitrary agents' interactions 
occur at the ticking T k of a Poisson clock of rate r. Moreover, with conditional probability r vw /r, any 
such interaction involves agent v updating her opinion to a convex combination of her current belief and 
the one of agent w, with weight 9 VW on the latter. It follows that, for all k > 0, and v G V, 



E 



X v (Tk+i)\J-T k ] — X v (T k ) — - ^ r vw 9 vw (X w (T k ) — X v (Tk)) — ^ Q vw X w {T k ) ■ 



Then, the above and the fact that the Poisson clock has rate r imply the left-most equation in (|19l) . 
Similarly, or all « ^ »' 6 V, one gets that 
E[X v (T k+1 )X v ,(T k+1 )\F Tk ] -X v {T k )X v ,{T k ) - lJ2 w r vw 9 vw {X w (T k )X v ,(T k ) - X v {T k )X v ,{T k )) 

+ r Sw' r v'w'8v'w' (X v (T k )X w >(T k ) - X v (T k )X v r(T k )) 
r ^2w,w' ^(v,v ')(w,w')X w X w i 



as well as 

nX 2 v {T k+1 )\T Tk ]-Xl(T k ) 



r Smi r vuM ((1 — 9 VW )X V + VW X W ) — X' L 

— ~^ ^^/w ^vw@vw {9vwX w 4- 2(1 VW ^X V X W (2 9 vw ^X v ^j 

— ^YlwQvw{^ — Oav) {x a x v ~ X"£) 

+ r Tlw' Qvw'(l — 6vw') (X V X W > — X^j 
~^~r Siu Qvw9vw (X w — X V J 
~~ r ^2w,w' K(v !V )(w,w')X w X w i . 

Then, the two identities above and the fact that the Poisson clock has rate r imply the right-most equation 
in (HD. ■ 



We are now in a position to prove the main result of this section characterizing the expected values 
and expected cross-products of the agents' stationary beliefs in terms of the hitting probabilities of the 
coupled random walks. Let us denote by T$ and T' s the hitting times of the random walks V{t), and 
respectively V'(t), on the set of stubborn agents S, i.e., 

T s := inf{< > : V(t) G S} , T' s := m£{t > : V'(t) G S} . 

Observe that Assumption 12.11 implies that both and T' s arc finite with probability one for every 
initial distribution of the pair (1^(0), V'(0)). Hence, for all v, v' G V, we can define the hitting probability 
distributions ^y v over S, and rf v over S 2 , whose entries are respectively given by 

^:=F v (V(Ts) = s), seS, 

rfj := ¥ VV ,{V{T S ) = s, V'{V S ) = s') , s, s' 6 S. 

Then, we have the following: 



Theorem 4.1 Let Assunwtion \2. 1\ hold. Then, for every value of the stubborn agents' beliefs {x s : s G 

E[X V ] = l>s , E[X V X V ,} = Vss^sXs- , (21) 

s s,s' 

for all v,v' G V. Moreover, {E[X V ] : o £ V} and {E[X v X v r] : v, v' G V} are the unique vectors in M. v , 
andM. VxV respectively, satisfying 

QavE[X v ] = , E[X S ] = x s , Va G A , Vs G S , (22) 

V 

K (a!a , Uw , wl) E[X w X w ,] =0, E{X V X V ,} = E[X v ]E[X vl ] , Vo,a' G A, V(u,u') G V 2 \„4 2 . (23) 

w,w' 
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Figure 6: In the left-most figure, expected stationary beliefs and variances in a social network with a 
line graph topology with n = 5, and stubborn agents positioned in the two extremities. The expected 
stationary beliefs are linear interpolations of the two stubborn agents' beliefs, while their variances follow 
a parabolic profile with maximum in the central agent, and zero variance for the two stubborn agents so, 
and s\. In the right-most figure, expected stationary beliefs in a social network with a tree-like topology, 
represented by different levels of gray. The solution is obtained by linearly interpolating between the two 
stubborn agents' beliefs, xq (white), and x\ (black), on the vertices lying on the path between sq and s±, 
and then extended by putting it constant on each of the connected components of the subgraph obtained 
by removing the edges of such path. 



Proof. It follows from (JTTfl and (fl9| that J2 s Xs 7s(t) an d ELY„(t)] satisfy the same linear system of 
differential equations with the same initial condition. On the other hand, Assumption 12.11 implies that 
lim^oo 7g(t) = 7J for every s G <S, and lim t _ i . 00 7„(t) = for every a 6 A. Therefore, one gets that 

lim E[X V (t)] = V 7 > s , VveV. (24) 

£— >oo L — ' 

s 

Now, if the initial belief distribution C(X(0)) coincides with the stationary one C(X), one has that 
C{X{t)) = C{X) for all t > 0, so that in particular E[X v (t)] = E[X V ], and hence rim t _ yoo E[X v (t)} = E[X V ] 
for all v. Substituting in the righthand side of (j24|) . this proves the leftmost identity in (|2"Tj) . The rightmost 
identity in (|21[) follows from an analogous argument. 

In order to prove the second part of the claim, observe that the expected stationary beliefs and 
belief cross-products necessarily satisfy (f2"2"j) and (f2U)) . since, by Lemma |4~T1 they evolve according to the 
autonomous differential equations ([!§]) , and are convergent by the arguments above. On the other hand, 
uniqueness of the solutions of (|22[) and (|23l) follows from [3] Ch. 2, Lemma 27]. ■ 

Remark 4.1 As a consequence of Theorem \4-l\ one gets that, if X a = {.t»} 7 then X a = x„, and, by 
Corollarv \3.1[ X a (t) converges to x* with probability one. This can be thought of as a sort of complement 
to TheoremWM 

5. Explicit computations of expectations and variances of the stationary beliefs We 

present now a few examples of explicit computations of the stationary expected beliefs and variances 
for social networks obtained using the construction in Example 12. 1\ starting from a finite undirected 
graph Q = (V,£). Recall that, in this case, Q av = 9/d a for all a 6 A, and s 6 V such that {a,v} € £ . 
It then follows from Theorem 14.11 that the expected stationary beliefs can be characterized as the unique 
vectors in R v satisfying 

E[X a ] = -J- E ^ ' E t Xs ] = X * ' Vfl G A ' VS G S ' ( 25 ) 

a r 1 r- c 
v:\v,a\£t 

and, if 9 = 1, the second moments of the stationary beliefs are the unique solutions of 

E[Xa 2 } = V E[X%] , E[X S 2 ] = x\ , Va e A , Vs G S . (26) 

a r 1 r- c 
v:{v,a}£c 
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Figure 7: Two social network with a special case of tree-like topology, known as star graph, and two 
stubborn agents. In social network depicted in left-most figure one of the stubborn agents, sq, occupies 
the center, while the other one, si, occupies one of the leaves. There, all regular agents' stationary beliefs 
coincide with the belief xq of sq, represented in white. In social network depicted in right- most figure, 
none of the stubborn agents, occupy the center. There, all regular agents' stationary beliefs coincide with 
the arithmetic average (represented in gray) of xq (white), and x\ (black). 



Example 5.1 (Tree) Let us consider the case when Q = (V, £) is a tree. Let the stubborn agent set S 
consist of only two elements, sq and s\, with beliefs Xq, and X\, respectively. 



If S a = {so} (respectively, S a = {si}), then Remark \4-1\ implies that K[X a ] = xo (resp., E[A" a ] = x\), 
and Var[X a ] = 0. Instead, if S a — {so,si}, then one has that 125\) is satisfied by 

BIV i _ d(v,s )x 1 +d(v,s 1 )x 
d(v,s ) + d{v,si) 

where d(v,w) denotes the distance in Q, between (i.e., the length of the shortest path connecting) nodes 
v and w. Hence, the stationary expected beliefs are linear interpolations of the beliefs of the stubborn 
agents. Moreover, if the confidence parameters are 8 e = 1 for all e, then \26\) is satisfied by 

2 = d{a,s )x 2 1 +d(a,s 1 )xl 
[ al d{a,s ) + d(a, Sl ) ' 
so that the stationary variance of agent a 's belief is given by 

d(a, so)d(a, s\) 



Vax[X a ]=-E[XZ}-E[X a } 2 = 



(.T - XlY 



(d(a, s ) + d(a, si)) 2 

The two equations above show that the belief of each regular agent keeps on oscillating ergodically around 
a value which depends on the relative distance of the agent from the two stubborn agents. The amplitude 
of such oscillations is maximal for central nodes, i.e., those which are homogeneously distant from both 
stubborn agents. This can be given the intuitive explanation that, the closer a regular agent is to a stubborn 
agent s with respect to the other stubborn agent s' , the more frequent her, possibly indirect, interactions 
are with agent s and the less frequent her interactions are with s' , and hence the stronger the influence 
is from s rather than from s'. Moreover, the more equidistant a regular agent a is from so, and si, the 
higher the uncertainty is on whether, in the recent past, agent a has been influenced by either sq, or s\. 

On its left-hand side, Figure reports the expected stationary beliefs and their variances for a social 
network with population size n = 5, line (a special case of tree-like) topology: the two stubborn agents are 
positioned in the extremities, and plotted in white, and black, respectively, while regular agents are plotted 
in different shades of gray corresponding to their relative distance from the extremities, and hence to their 
expected stationary belief. In the right-hand side of Figure® a more complex tree-like topology is reported, 
again with two stubborn agents colored in white, and black respectively, and with regular agents colored 
by different shades of gray corresponding to their relative vicinity to the two stubborn agents. Figure [7] 
reports two social networks with star topology (another special case of tree). In both cases there are two 
stubborn agents, colored in white, and black, respectively. In the left-most picture, the white stubborn 
agent occupies the center, so that all the rest of the population will eventually adopt his belief, and is 
therefore colored in white. In the right-most picture, none of the stubborn agents occupies the center, and 
hence all the regular agents, hence colored in gray, are equally influenced by the two stubborn agents. 
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Figure 8: A social network with population size n = 12, a barbell-like topology, and two stubborn agents. 
In each of the two halves of the graph the expected average beliefs concentrate around the beliefs of the 
stubborn agent in the respective half. 



Example 5.2 (Barbell) For even n > 6, consider a barbell-like topology consisting of two complete 
graphs with vertex sets Vo, and V±, both of size n/2, and an extra edge {ao,ai} with oq G Aq, and 
ai G A\ (see Figure^. Let S = {sq,si} with sq ^ ap € Vb and Sx ^ a% G Vi. Then, \25\) is satisfied by 



^+8 Xs o + ^Ts^si if a = a 
g±f z So + AsX Sl if a G A \ {a } . 



n+8* 

In particular, observe that, as n grows large, E[X a ] converges to x So for all a G Aq, and K[X a ] converges 
to x Sl for all a G Ai. Hence, the network polarizes around the opinions of the two stubborn agents. 

Example 5.3 (Abelian Cayley graph) Let us denote by Z m the integers modulo m. Put V = and 
let C V \ {0} be a subset generating V and such that if x G 0, then also —x G 0. The Abelian Cayley 
graph associated with Q is the graph Q = (V, £) where {v,w} £z£ijfv~w<E<d. Notice that Abelian 
Cayley graphs are always undirected and regular, with d v = |0| for any v G V. Denote by ej G V the 
vector of all O's but the i-th component equal to 1. If = {±ei, . . . ,±ed} ; the corresponding Q is the 
classical d- dimensional torus of size n = m d . In particular, for d = 1, this is a cycle, while, for d = 2, 
this is the torus (see Figure^). 

Let the stubborn agent set consist of only two elements: S := {so,si}. Then the following formula 
holds (see Ch. 2, Corollary 10]): 

7 J = P„ (T S1 < T sa ) = E^ -E^+E^ (2?) 

where E vw := ~K V \T W ] denotes the expected time it takes to a random walk started at v to hit for the first 
time w. On the other hand, average hitting times E vw can be expressed in terms of the Green function 
of the graph, which is defined as the unique matrix Z G R VxV such that 

Z1=0, {I - P)Z = I -n- 1 !! 7 , 

where 1 stands for the all-1 vector. The relation with the hitting times is given by: 

E vw = n 1 (Z WW — Z vw ) . (28) 

Let P be the stochastic matrix corresponding to the simple random walk on Q . It is a standard fact 
that P is irreducible and its unique invariant probability is the uniform one. There is an orthonormal 
basis of eigenvectors for P good for any 0: if I = (lx, . . . Id) G V define <fii G M. v by 

/ 077-7 \ 

=m _d/2 exp ( l-kj , k = (ki,...,k d ) G V, 
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(where I -k = Y]^ Ijkj). The corresponding eigenvalues can be expressed as follows 



h E cos (^- fc 



A ' = |e , 

where + is any subset of such that for all x £ 0, \{x, —x} PI + | = 1. Hence 



exp \—l ■ (v — u> I 
rri 1 - t^ft E cos ■ k] y ' 



From fj?7| ], {HHJ], and the fact that E SoSl = E SlSo by symmetry, one obtains 

exp [^/ • (a - Sl )] - exp [&1 ■ (a - s )] 



rn 



E 



1 i^O © + ^ Lm J 

2 o— dV- 1 - cos [-/ • ( So - Sl)] 



2m -d ^2 - 



TTie expected stationary beliefs can then be computed using Theorem \4-l\ and £2 



6. Homogeneous influence in highly fluid social networks In this section, we present estimates 
for the stationary expected beliefs and belief variances as a function of the underlying social network. We 
will confine ourselves to considering social networks satisfying an additional assumption of reversibility 
formulated below. Let us recall the definition of the matrix P £ R- /l><v associated to a social network. 

Assumption 6.1 The restriction of the matrix P defined by to A x A is irreducible and reversible, 
i.e., there exist positive values ir a , for a £ A, such that 

K a Paa> = ^a'Pa'a , Vo, a' £ A. (31) 

Condition (|31l) entails a certain form of reciprocity between the intensity of influence of a regular agent 
on another, and vice versa. In particular, it implies that if (a, a') £ £ , then also (a', a) £ £ , so that the 
restriction of the di-graph y to A is in fact undirected. We will refer to social networks whose associated 
matrix P satisfies Assumption 16.11 as reversible (social) networks. 

Observe that, whenever Assumption 16.1 1 is satisfied, the vector {fr a : a £ A} is uniquely defined up 
to a multiplicative constant: to see this, fix the value n a on some a, then (|31[) fixes the entries n a i for a' 
in the out-neighborhood of a, and the irreducibility assumption allows one to iterate the argument until 
covering the whole A. Now, given a reversible social network, it is possible to extend the matrix P on 
S x V as follows: Put P ss > := for all s, s' £ S, and 

if. := E *» P ™ > Psa-=Pas^, s£S,a£A. (32) 

'■ — ' 7T„ 

aeA S 
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In particular, P sa does not depend on the particular choice of 7T, and, extended in this way, P becomes an 
irreducible and reversible stochastic matrix on V. Furthermore, the probability measure n on V, defined 

by 

7T V := , Kv'J n v , (33) 

is its unique invariant distribution. The measure of the stubborn agents' set under such a distribution is 
given by 

tt(s) = e ^ = (e ^r 1 e *« p « ( 34 ) 

Observe that (|3Tj) and (|32|) imply that P vw > if and only if P vw > 0. It is then natural to associate 
to any social network satisfying Assumption 16. ll an undirected graph Q = (V, £), in which G £ 

if and only of P vv > > 0. From now on, we refer to this undirected graph Q , rather than to the directed 
graph ~$ considered so far. Clearly, a given undirected graph Q may be associated to many reversible 
social networks. 



Remark 6.1 Given a reversible social network, the one proposed above is not its only possible extension 
of its matrix P that makes it irreducible and reversible, as one may allow, e.g., for non-zero valued P ss > ■ 
However, our subsequent analysis is valid for all such extensions, while tightness of the estimates obtained 
may vary with the choice of such an extension. 

Example 6.1 Let us consider the canonical construction of a social network from a given undirected 
graph Q = (V,£), explained in Examvle \2.1\ Extend P by putting P sv = l/d s , for all s G S, and v G V 
such that {s,v} G £, and P sv = 0, for all s G S, and v G V such that {s,v} £. Then, Assumvtion \6. 1\ 
can be checked to hold, with the invariant measure given by 

tt v = d v / (nd) , 

where d v is the degree of node v in Q and d := * s ^ e average degree of Q. Observe that, in 

this construction, ir(S) = d v ) 1 ^ s d s is the fraction of edges incident to the stubborn agents, or, in 
other words, the relative size of the boundary of S in Q. 



We introduce the following definition. 



Definition 6.1 Given a reversible social network, let P be defined as in (0), and extended as in H32\) . 
and 7r denote its stationary distribution defined as in \33\l . Define 7r* := min„ n v , and let 

(35) 



r:=inf|t>0: E l P «(^(*) = w ) ~ ^v(V(t) = w)\ < ^,Vw,w'gv| 



denote the (variational distance) mixing time of the continuous-time Markov chain V(t) with state space 
V , and generator matrix P — I . The fluidity of the social network is the ratio 

* := ■ 36 

A sequence of social networks (or, more briefly, a social network) of increasing population size n is highly 
fluid if $ diverges as n grows large. 



Our estimates will show that for large-scale highly fluid social networks, the marginal distributions of 
the stationary beliefs of most of the regular agents in the population can be approximated (at least in 
their first and second moments) by the distribution of a weighted-mean belief Z, supported in the finite 
set X := {x s : s G S}, and given by 

V(Z = x)= E 7., % :=^2 v n vl v s , seS. (37) 

s: x s —x 

We refer to the probability distribution {7^ : s G S} as the stationary stubborn agent distribution. 
Observe that j s = P^V^Ts) = s) coincides with probability that the random walk V(t), started from 
the stationary distribution n, hits the stubborn agent s before any other stubborn agent s' G <S. In fact, 
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as we will clarify below, one may interpret j s as a relative measure of the influence of the stubborn agent 
s on the society compared to the rest of the stubborn agents s' G S. 

More precisely, let us denote the expected value and variance of the weighted-mean belief Z by 

nZ]:=J2ls^, o%:=Y, a %(x a -E[Z\f . (38) 
Let (7% denote the variance of the stationary belief of agent v, 

ol :=E[A 2 ] -E[X V } 2 . 

We also use the notation A* to denote the maximum difference between stubborn agents' beliefs, i.e., 

A* := max {x s — x s > ■ s, s € S} . (39) 



The next theorem presents the main result of this section. 



Theorem 6.1 Let Assumptions [Ql and 1 6. II hold, and assume that n(S) < 1/4. Then, for all s > 0, 



: k[X v ] -E[Z] > A,e} 



< 



(40) 



with ip(e) := We 1 log(2e 2 /e). Furthermore, if the trust parameters satisfy 8 av = 1 for all (a,v) G £ , 
then 



1 
n 



> A 



< 



(41) 



This theorem implies that in large-scale highly fluid social networks, as the population size n grows 
large, the stationary expected beliefs and variances of the regular agents concentrate around fixed values 
corresponding to the expected weighted-mean belief E[Z], and, respectively, its variance o-\ (see Fig.s 
1101 and [TT j) . We refer to this phenomenon as homogeneous influence of the stubborn agents on the rest 
of the society — meaning that their influence on most of the agents in the society is approximately the 
same. Indeed, it amounts to homogeneous (at least in their first two moments) marginals of the agents' 
stationary beliefs. This shows that in highly fluid social networks, most of the regular agents feel the 
presence of the stubborn agents in approximately the same way. 

Intuitively, if the set S and the mixing time r are both small, then the influence of the stubborn agents 
will be felt by most of the regular agents much later then the time it takes them to influence each other. 
Hence, their beliefs' empirical averages and variances will converge to values very close to each other. 
Theorem 16.11 is proved in Section 16.21 Its proof relies on the characterization of the expected stationary 
beliefs and variances in terms of the hitting probabilities of the random walk V(t). The definition of 
highly fluid network implies that the (expected) time it takes V(t) to hit S, when started from most of 
the nodes of Q, is much larger than the mixing time r. Hence, before hitting S, V(t) looses memory of 
where it started from, and approaches S almost as if started from the stationary distribution tt. 

It is worth stressing how the condition of homogeneous influence may significantly differ from an 
approximate consensus. In fact, the former only involves the (the first and second moments of) the 
marginal distributions of the agents' stationary beliefs, and does not have any implication for their joint 
probability law. A chaotic distribution in which the agents' ergodic beliefs arc all mutually independent 
would be compatible with the condition of approximately equal influence, as well as an approximate 
consensus condition, which would require the ergodic beliefs of most of the agents to be close to each 
other with high probability. We will address the investigation of this topic in another work. 

Before proving Theorem 16.11 we present some examples of highly fluid social networks in Section 16.11 



6.1 Examples of large-scale social networks We now present some examples of family of social 
networks that are highly fluid in the limit of large population size n. All the examples will follow the 
canonical social network construction of Example 12. 1[ starting from an undirected graph Q. Before 
proceeding, let us recall that the invariant measure of the stubborn agents set 7r(<S) is given by 



tt(5) = V d s /(nd) , 

L * S 



(42) 
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Figure 10: Homogeneous influence in Erdos-Renyi graphs of increasing sizes. The population sizes are 
n = 100 in (a), n = 500 in (b), and n = 2000 in (c), while p = 2n~ 1 logn. In each case, there are two 
stubborn agents randomly selected from the node with uniform probability and holding beliefs equal to 0, 
and 1, respectively. The figures show the empirical density of the expected stationary beliefs, for typical 
realizations of such graphs. As predicted by Theorem 16.11 such empirical density tends to concentrate 
around a single value as the population size grows large. 



and observe that 7r*n < 1, with equality if and only if n is the uniform measure over V. Hence, one has 
7r*n = 1 for regular graphs, while, for general undirected graphs (ir^n)^ 1 < d, where d is the average 
degree of the graph. 

We start with an example of a social network which is not highly fluid. 

Example 6.2 (Barbell) For even n > 6, consider the barbell-like topology introduced in Example \ 5.2\ 
The mixing time of this network can be estimated in terms of the conductance 0* of the graph, which 
is defined as the minimum over all subsets V' C V with < X^ev < nd/2, of the ratio between the 
number of edges connecting V' with its complement, and the sum of the degrees of the nodes in V. It is 
not hard to see that such a minimum is achieved by V' = Vo, so that 0* = (^(^ — 1) + l) < ( n +xy ■ 
Using J28[ Theorem 7.3], it then follows that r > (4^) H ,) _1 > (n + 1) 2 /16. Since d v > n/2 — 1 for all v, it 
follows that the barbell-like network is never highly fluid provided that \S\ > 1. In fact, we have already 
seen in Example \5.2\ that the expected stationary beliefs polarize in this case. 

Let us now consider a standard deterministic family of symmetric graphs. 

Example 6.3 (d- dimensional tori) Let us consider the case of a d-dimensional torus of size n = m , 
introduced in Examvle \5.3\ Since this is a regular graph, one has n*n = 1. Moreover, it was proved by Cox 
U5f that, as n grows large, t ~ Cd,n 2 / d , for some constant Cd depending on the dimension d only. Then, 
ttt(S) ~ |iS|n 2 / d_1 . Hence, if \S\ = o(n 2 / d_1 ), then the social network with toroidal topology is highly 
fluid. In fact, using Fourier analysis, one may show that \S\ = o(n 1//d_1 ) suffices. In contrast, for the 
one- dimensional torus (i.e., a ring) of size n, both E^ps] ~ n 2 and TC2 ~ n 2 ; in fact, using the explicit 
calculations of Example 15.11 one can see that the expected stationary beliefs do not concentrate in this 
case. Finally, the two-dimensional torus is not highly fluid, hence Theorem \6.1\ is not sufficient to prove 
that the empirical beliefs concentrate around E[Z]. Nevertheless, one could use the explicit expression 
h3U\) and Fourier analysis in order to show that the condition \S\ = o(n 1 / 2 ) would suffice for that. 

An intuition for this behavior can be obtained by thinking of a limit continuous model. First recall that 
the expected stationary beliefs vector solves the Laplace equation on Q with boundary conditions assigned 
on the stubborn agent set S. Now, consider the Laplace equation on a d-dimensional manifold with 
boundary conditions on a certain subset. Then, in order for the problem to be well-posed, one needs that 
the such a subset has dimension d — 1 . Similarly, one needs \S\ = e(n (d - 1)/d ) = eiW*- 1 ) in order to 
guarantee that the expected stationary beliefs vector is not almost constant in the limit of large n. 

We now present four examples of random graph sequences which have been the object of extensive 
research. Following a common terminology, we say that some property of such graphs holds with high 
probability, if the probability that it holds approaches one in the limit of large population size n. 
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Figure 11: Homogeneous influence in preferential attachment networks of increasing sizes. The figures 
show the empirical density of the expected stationary beliefs, for typical realizations of such graphs. The 
population sizes are n = 100 in (a) and (d), n = 500 in (b) and (e), and n = 2000 in (c) and (f), while 
m = 4. In each case, there are two stubborn agents holding beliefs equal to 0, and 1, respectively. In 
(a), (b), and (c), the stubborn agents are chosen to coincide with the two latest attached nodes, and 
therefore tend to have the lowest degree. In contrast, in (d), (e), and (f), the stubborn agents are chosen 
to be the two initial nodes, and therefore tend to have the highest degrees. As predicted by Theorem 
16.11 the empirical density of the expected stationary beliefs tends to concentrate around a single value 
as the population size grows large. The rate at which this concentration occurs is faster in the top three 
figures, where ^ s d s is smaller, and slower in the bottom three figures, where ^ s d s is larger. 



Example 6.4 (Connected Erdos-Renyi) Consider the Erdos-Renyi random graph Q = £1Z(n,p), i.e., 
the random undirected graph with n vertices, in which each pair of distinct vertices is an edge with 
probability p, independently from the others. We focus on the regime p = cn logn, with c > 1, where 
the Erdos-Renyi graph is known to be connected with high probability \19[ Thm. 2.8.2]. In this regime, 
results by Cooper and Frieze llJfl ensure that, with high probability, t = O(logn), and that there exists a 
positive constant 5 such that 8c log n < d v < 4c log n for each node v \19[ Lemma 6.5.2]. In particular, it 
follows that, with high probability, (K^n)" 1 < 4/6. Hence, using \4-2fy , one finds that the resulting social 
network is highly fluid, provided that \S\ = o(n/ log n), as n grows large. Figure [7771 shows the empirical 
density of the expected stationary beliefs for typical realizations of Erdos-Renyi graphs of increasing size 
n = 100,500,2000, and constant stubborn agents number \S\ = 2. 

Example 6.5 (Fixed degree distribution) Consider a random graph Q = FT>{n,X), with n vertices, 
whose degree d v are independent and identically distributed random variables with ¥(d v = k) = Afe, for 
k G N. We assume that X\ = X-2 = 0, that \2k > for some k > 2, and that the first two moments 
d := J2k^kk, and^2 k \kk 2 are finite. Then, the probability of the event E n := {%2 v d v is even} converges 
to 1/2 as n grows large, and we may assume that Q = TT>(n, A) is generated by randomly matching the 
vertices. Results in \19[ Ch. 6.3] show that r = O(logn). Therefore, using \J^2^ , one finds that the 
resulting social network is highly fluid with high probability provided that ^ s d s — o(n/\ognj . 



Example 6.6 (Preferential attachment) The preferential attachment model was introduced by 
Barabasi and Albert f^j to model real-world networks which typically exhibit a power law degree dis- 
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tribution. We follow U91 Ch. 4] and consider the random graph Q = VA{n,m) with n vertices, gen- 
erated by starting with two vertices connected by m parallel edges, and then subsequently adding a new 
vertex and connecting it to m of the existing nodes with probability proportional to their current de- 
gree. As shown in U91 Th. 4-1-4], the degree distribution converges in probability to the power law 
V(d v = k) = Afc = 2m(m + \)/k(k + l)(fc + 2), and the graph is connected with high probability \19[ 
Th. 4-6-1]- In particular, it follows that, with high probability, the average degree d remains bounded, 
while the second moment of the degree distribution diverges an n grows large. On the other hand, results 
by Mihail et al. J32}/ (see also il!A Th. 6.4-2]) imply that the mixing time r = O(logn). Therefore, thanks 
to \4>ty , the resulting social network is highly fluid with high probability if^2 seS d s = o(n/\o, 



Example 6.7 (Watts & Strogatz's small world) Watts and Strogatz 14^ , and then Newman and 
Watts \S1^ proposed simple models of random graphs to explain the empirical evidence that most social 
networks contain a large number of triangles and have a small diameter (the latter has become known 
as the small-world phenomenon). We consider Newman and Watts' model, which is a random graph 
Q = J\fW(n,k,p), with n vertices, obtained starting from a Cayley graph on the ring Z„ with generator 
{— fc, — k + 1, . . . , —1, 1, . . . , k — 1, k}, and adding to it a Poisson number of shortcuts with mean pkn, 
and attaching them to randomly chosen vertices. In this case, the average degree remains bounded with 
high probability as n grows large, while results by Durrett \ 191 Th. 6.6.1] show that the mixing time 
t = 0(log 3 n). This, and E| ) imply that the network is highly fluid with high probability provided that 
E se5 d * = o(n/log 3 n). 

6.2 Proof of Theorem 16.11 Recall that Theorem H4. II allows one to express the stationary expected 
beliefs and belief variances can in terms of the hitting probability distributions 7 U on the stubborn agent 
set S of a continuous-time Markov chain with state space V, and generator matrix Q. Observe that such 
hitting probabilities only depend on the restriction of the matrix P to A x V, while they are independent 
of the holding rates of the chain V(t), as well as of the specific extension of P to S x V. As a consequence, 
without any loss of generality, one can assume — as we will — that the extension of P to S x V is given 
as in (|32[) . and that the holding times of V(t) in every state have exponential distribution of rate 1 (or, 
equivalently, that the generator matrix of V(t) is P — I). 

In order to prove Thcorcm l6.ll we will obtain estimates on the hitting probabilities of the random walk 
V(t) on V with generator matrix P. We start by stating a standard result on the distance of transition 
probability distribution of a random walk from its stationary distribution. 

Proposition 6.1 Ch. 4, Lemma 5] Let V(t) be a continuous-time Markov chain on V with irreducible 
jump matrix P, and holding times with rate-1 exponential distribution. For v G V, and t > 0, let '/"(t) 
be the probability distribution ofV(t), conditioned on V(0) = v. Then, 



max 



7 *(t)- 7 "(t) ^<exp(l-t/r), V*>0. 



where r is the mixing time [cf. Eq. i35\) I. 

The following result, whose proof is an application of Proposition 16. 1[ provides a useful estimate on 
the total variation distance between the hitting probability distribution -y 11 over S and the stationary 
stubborn agent distribution 7 . 

Lemma 6.1 Let V(t) be a continuous-time Markov chain on V with irreducible jump matrix P, and 
holding times with rate-1 exponential distribution. Let "f v be the hitting distribution on S C V for the 
chain V(t) started in v G V, as defined in i20\). and 7 :— ^2 V ^ V J V , where n is the unique invariant 
distribution of P. Then, for all t > 0, and v G V, 

\\l v ~l\Wv <p„(i)+exp(-i/r + l), (43) 

where p v (t) := P„ (T s < t). 

Proof. Notice that (|43|) is trivial when v G S, for in that case p v (t) = 1- For a G A, one reason as 
follows. Let f s := inf{f > t : V(t) G <S}. Using the identity 



\i - v\\ TV = \ sup (V" (fj, v - v v )f v \ 
2 / S [-i,i]v 
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(see, e.g., [25J Prop. 4.5]), and observing that the event {Ts > t} implies Vr s = one gets that 



y Q -E ^b" 

Z J 7j 



TV 



— sup 



/6[ 



1 

— sup 



LP fEa 
1,1]V l - 



.A 



f\ 



} 



l P iV { E ° 1 {Ts<t} [fv Ts ~ fv ts ) } < Pa(t) 



/e[-i,ip 

On the other hand, since every Markov kernel is contractive in total variation distance, one has that 
II $>„W "7||tv = II ~ ^ ~\\tv< \h a (t) - 7r|| T y • 



By applying the triangle inequality, the two estimates above, and Proposition 16. 1[ one shows that 
||7 a -7llTV < ||7°-E*7£(*)7 , 'I|tv + II £„ 7?(t)7 -7llrv 
< Pa (t) + \\j a {t)-ir\\ TV 



< p„(t) + exp(-t/r + 1) , 



thus proving the claim. 



Lemma I6T21 stated below, is the main technical result of this section. Its proof relics on the "approxi- 
mate exponentiality" of the hitting time T$- This is the property that the probability law of Ts is close 
to the exponential distribution with expectation E^ps] when the initial distribution is the stationary 
one, and the mixing time r is small with respect to the expected hitting time E^ps]. In particular, we 
make use of the following result, due to Aldous and Brown: 

Proposition 6.2 ff3J Ch. 3, Prop. 23]) Let V(t) be a continuous-time Markov chain on V with holding 
times exponentially distributed with rate 1, irreducible jump matrix P , and stationary distribution ir. Let 
T2 be its relaxation time, i.e., the inverse of the spectral gap of P. Then, for all S C V, 

sup |P X (T 5 > t) - cxp(-t/E T [T 5 ])| < r 2 /E T [T 5 ] . 
t>o 



Lemma 6.2 Let Assumptions 

1 

n 



{v e V 



and \6.1\ hold. Then, for all e > 0, 
21og(2e 2 /e) 



7||tv > e}\ < 



(44) 



PROOF. Let p v (t) := P V (T S < t). From Lemma loTTl and Proposition 16.21 it follows that, for all t > 0, 



KvPv{t) = {T s < t) < 1 - exp 



E.ps 



< 



t + T 2 

E W [T S ] 



where the last step follows from the inequality 1 — e x < x. Hence, Markov's inequality implies that 

2 t + T 2 



-\{v: Pv {t) >e/2}\ < - Y'-p v (t) < -^—J^nvPvit) < 



snir* Ejr [Ts] 



(45) 



Now, choose t = rlog(2e/e), so that exp(-t/r + 1) = e/2, and t + r 2 < rlog(2e/e) + r = r(log(2e 2 /e)), 
thanks to the inequality r 2 < r (see, e.g., [3] Ch. 4, p. 2]). Then, applying (|43j) and (|45|) yields 



-\{v: \W -^\\ TV > e }\ < - {v. \\Y(t)~7T\\ TV >^} 
n n I 2 J 



< 



21og(2e 2 /g)T 
£n7r*E„.[Ts] 



which proves the claim. 



Lcmma l6.2l is particularly relevant when r is much smaller than E ff [T5]. Indeed, in this case, it shows 
that, for all but a negligible fraction of initial states v £ V, the hitting probability distribution 7" will be 
close to the stationary stubborn agent distribution 7. The intuition behind this result is rather simple: 
if the chain V(t) mixes much before hitting the stubborn agents set S, then it will hit some s before any 
other s' £ S with probability close to j s , independently of the initial state. While the expected hitting 
time E^p^] may be computable in certain cases, it is often easier to estimate it in terms of the invariant 
measure of the stubborn agent set, n(S), e.g., using the following result: 
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Proposition 6.3 Proposition 7.13] For all SCV, E^[T S ] > 1/(2tt(<S)) - 3/2. 
Lemma 16.21 and Proposition 16.31 immediately imply the following result: 



Lemma 6.3 Let Assumptions \27l\ and \6.1\ hold, and assume that 7r(«S) < 1/4. Then, for all e > 0, 

-\{v: || 7 «- 7 || TV >e}|<^, 
where ip(s) := 16e~ 1 log(2e 2 /e) ; and $ is the fluidity of the network, as defined by h36\l . 

PROOF. The assumption tt(S) < 1/4 implies that 3/(8^(5)) > 3/2, so that, by Proposition 16.31 
EttPs] > l/(27r(<S)) — 3/2 > l/(8ir(S)). The claim now follows by applying this bound to the righthand 
side of flU]). ■ 



Proof of Theorem Iff. 11 

Let y s := x s + A*/2 — maxjav : s' £ S} for all s G S. Clearly \y s \ < A*/2. Then, it follows from 
Theorem O that 

E[X V ] - E[Z] = | 7> s - E =\J2 1bV> - E 7.1/- < A,|| 7 U - 1\\tv , 



so that (|40| immediately follows from Lemma I6T3I 

On the other hand, in order to show (|4Tj) . first recall that, if 6* e — 1 for all e G £ , then Eq. (fl5|) provides 
the transition rates of coalescing random walks. In particular, if 1^(0) = V'(0), then V(Ts) = V'(T' S ), so 
that t)™i = Is if s — s '; an£ i ^ss' = ^ otherwise. Then, it follows from Theorem 14.11 that 

oi = E[X^}-E[X V } 2 

= E S , S 'C'W-(E S 7X) 2 

= E,7^-(E,7^) 2 

= !£.£y7?7S(s.-av) a . 
Similarly, o\ = \ E S , S ' 7 s 7s'( a; s ~ s S ') 2 , so that 

k 2 -4l < 5E s vl7 s u 7j'-7 s 7 s 'l(^-^) 2 



2 



< \ E S , S ' (7? W -7 S 'I+ 7 S "' |7J - 7.1) A 
= || 7 l '-7ll T yA2, 

and (|41l) follows again from a direct application of Lemma 16.31 



2 



7. Conclusion In this paper, we have studied a possible mechanism explaining persistent disagree- 
ment and opinion fluctuations in social networks. We have considered a stochastic gossip model of 
continuous opinion dynamics, combined with the assumption that there are some stubborn agents in the 
network who never change their opinions. We have shown that the presence of these stubborn agents 
leads to persistent oscillations and disagreements among the rest of the society: the beliefs of regular 
agents do not converge almost surely, and keep on oscillating in an ergodic fashion. First and second 
moments of the stationary beliefs distribution can be characterized in terms of the hitting probabilities of 
a random walk on the graph describing the social network, while the correlation between the stationary 
beliefs of any pair of regular agents can be characterized in terms of the hitting probabilities of a pair of 
coupled random walks. We have shown that in highly fluid, reversible social networks, whose associated 
random walks have mixing times which are sufficiently smaller than the inverse of the stubborn agents' 
set size, the vectors of the stationary expected beliefs and variances are almost constant, so that the 
stubborn agents have homogeneous influence on the society. 



2G 
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